Fluctuation and dissipation of work in a Joule experiment. 
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We elucidate the connection between various fluctuation theorems by a microcanonical version of 
the Crooks relation. We derive the microscopically exact expression for the work distribution in an 
idealized Joule experiment, namely for an object, convex but otherwise of arbitrary shape, moving 
at constant speed through an ideal gas. Analytic results are compared with molecular dynamics 
simulations of a hard disk gas. 
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Microscopic time-reversibility implies, in a system at 
equilibrium, the basic symmetry of detailed balance, stat- 
ing that any process and its time reverse occur equally 
frequently. In the linear regime outside equilibrium this 
property entails, as Onsager has first shown, a relation 
between fluctuation and dissipation, since in this regime 
one cannot distinguish between the average regression 
following an external perturbation or an equilibrium fluc- 
tuation. Over the past decade, time-reversibility of deter- 
ministic or stochastic dynamics has been shown to imply 
relations between fluctuation and dissipation in systems 
far from equilibrium, taking the form of a number of 
intriguing equalities, the fluctuation theorem P, , the 
Jarzynski equality [2j and the Crooks relation In 
this letter, we want to stress the relation between these 
results and discuss their relevance by a microscopically 
exact study of a Joule experiment. 

Our theoretical starting point will be the derivation 
of a microcanonical version of the Crooks relation. This 
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FIG. 1: Work distributions for a triangular object moving to 
the +x (upper panel) and —x direction (lower panel). Inset: 
detail of the multiple peak structure for r = 5. 



result has the advantage that we can consider from the 
onset an isolated system, thereby dispensing with the 
need for considering a heat bath. In the limit of an in- 
finitely large system, we recover the three above men- 
tioned equalities. The validity and experimental observ- 
ability of these relations and their interconnection can be 
discussed from the exact result for distribution of work 
when moving a convex object through an ideal gas. 

Consider an isolated system at time t = in mi- 
crocanonical equilibrium at energy E. Its Hamiltonian 
depends on a control parameter, which is varied dur- 
ing the time interval [0, t] following a specified protocol. 
An initial position Xi of the system in phase space will 
evolve according to Hamiltonian dynamics into a final 
position xt. The corresponding initial and final values 
of the Hamiltonian are denoted by Hi(xi) and Hf(xf), 
respectively. During this process, an amount of work 
W = Hf(xj) — Hi(xi) is delivered to the system. Due to 
the microcanonical sampling of the initial state from the 
energy shell Hi = E, the work IF is a random variable 
with the following probability density: 



P E {W) = (5(H f (x f ) - H^) - W)) E 
= J d Xl d(Hi{x t ) - E)S(W - Hf(x f ) + Hjjxj)) 



(1) 



where ft^E) = J dxiS{H t (xi) - E) = exp{Si(E)/k B } 
is the volume of the energy shell and Si(E) is the en- 
tropy at the initial equilibrium state. Consider now the 
time-reversed protocol. A phase point Xf, where the tilde 
refers to velocity inversion, will evolve in time to the final 
phase space position x^. We now average over a micro- 
canonical sampling in the energy shell Hf(xf) = E + W. 
The probability distribution Pe+w{—W) for a work — W 
in this time reversed protocol is given by: 

Pe+w{~W) = (5{Hf(x f ) - Hi{xi) - W)) E +w 
_ fdx f 6(H f (x f ) -E- W)S(H f (xf) - Hi{xi) - W) 



n f (E + w) 



(2) 



Since the Jacobian for the transformation from dxi to 
dxf is one, the integrals in Eqs. Q and |j2J are identical, 
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and the following microcanonical Crooks relation follows: 



p e {w) _n f (E + w) 



S f (E+W)-S i (E) 



P. 



E+W 



(3) 



In an appropriate thermodynamic limit, entailing E — > 
oo, the work distributions converge to functions P(W) 
and P(—W), independent of the energy of the system, 
while the temperature T, dS/dE = 1/T, is a well defined 
constant (i.e., same for the initial and final microcanoni- 
cal distribution). Since AF = AE — TAS and AE = W 
the internal energy difference, one recovers the canonical 
Crooks relation 



P(W) 

= exp , 

P{-W) I 



(4) 



from which the Jarzynski relation (exp(— f3W)) — 
exp(— (3AF) follows by integration. Note that in the 
aforementioned thermodynamic limit, entailing W/E — > 
0, AF = W - T(S f {E + W) - Si(E)) -> -T{S f {E) - 
Si(E)) is the free energy difference between final and ini- 
tial state at same energy E, independent of W . Note also 
that for a protocol of asymptotically long duration t — > 
oo, that leads the system into a nonequilibrium steady 
state, one can write AS = ta, where a is the entropy pro- 
duction per time unit, while W = AF+TAS w Tta . Eq. 
ijlj then can be rewritten P{a)/ P(—a) ~ exp^cr/fee), 
which in the particular case of a time-symmetric sched- 
ule with P = P reduces to the Evans-Cohen-Gallavotti 
fluctuation theorem 0, . 

As an application of the above result, we turn to an ex- 
actly solvable microscopic model of a Joule experiment: 
an ideal gas at equilibrium in an infinitely large container 
receives an amount of mechanical energy W by moving 
a closed convex body through it during a time duration 
t at a fixed speed V along a fixed horizontal axis x (see 
also Fig. |2J). We will calculate explicitly the probabil- 
ity distribution P(W) for this work. For simplicity and 
for comparison with molecular dynamics, we restrict our- 
selves to a two-dimensional system, with vertical axis y. 
The shape of the object is completely specified by the 
circumference S and the form factor F(9), with F(9)d9 
defined as the fraction of the circumference with polar 
angle between 9 and 9 + d9, the angle being measured 
counterclockwise from the x-axis (see Ref. 5J). When a 




FIG. 2: Snapshots for a triangular object moving to the left 
(lhs panel) and to right (rhs panel). Note the void behind the 
object when it moves in the direction of its arrow (rhs panel) . 



gas particle hits the object, the amount of work AW 
supplied by the external force is equal to the increase in 
kinetic energy of the particle. The post-collisional speed 
is found in terms of the (precollisional) speed v = (v x , v y ) 
from the conservation of total energy and total momen- 
tum in the rr-direction. The resulting work contribution 
is AW = ~2mV sin 2 9{v x —V — v y cot 9). Note that this 
quantity is a random variable, through its dependence on 
the speed of the incoming particle and of the inclination 
9 of the impact point. In the case of an ideal gas at equi- 
librium (or in the limit of a extremely dilute gas, with the 
mean free path of the object much larger that its linear 
dimension, the so-called large Knudsen number regime), 
the subsequent collisions arc independent random events. 
Hence the total work W(t) after a time t, being the sum of 
uncorrelated identically distributed AVF's, is a stochastic 
process with independent increments. The time evolu- 
tion of the work distribution P(W, t) is described by the 
following Master equation: 

/+oo 
T(AW){e- AW9w - l)P(W,t)dAW. 
-oo 

(5) 

The probability per unit time T(AW) for a change in W 
by an amount AW can be calculated following the basic 
methods of kinetic theory, and is given by: 



OO p + OG 



T(AW) = / SF(9)d9 / / 

J J — oo J —oo 



dv x dv y 



x p<f>(v x ,v y )H[(V - v).e ± (9)]\{V - v).e ± {9)\ 
x 5[AW + 2mVsin 2 9(v x -V -v y cot9)}, 



(6) 



where H denotes the Heaviside function, V — (V, 0), 
e±(9) is the vector orthogonal to the circumference at 
the orientation 9, while the delta functions picks out the 
incoming speeds that give rise to the requested work con- 
tribution AW. The gas is characterized by the (uni- 
form) density p and the Maxwellian velocity distribution 
4>{ v x,v y ) at temperature T. The solution of the Mas- 
ter equation is found by Fourier transform, and is most 
easily expressed in terms of the following dimensionless 
variables: 

1/2 



V 



(3m 



Spt 



(7) 



2 J ' (2/3m) 1 /2' 

being the work and speed measured in terms of the ther- 
mal energy and speed of the gas particles, and the time 
in terms of the average time between collisions. The cu- 
mulant generating function G(q) = \og(e~ lqw ) reads: 



G(q) = log 



e- iqw P(w,T)dw 



rj d9F(9)vsm9{ (erf[(l - 2iq)vsint 



x{l-2tq)e- 4q(l+q)v2 



— 1 — erf (v sin t 



(8) 
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Note that, as expected, the work distribution is invariant 
under velocity inversion v — > — v for symmetric objects 
F{9) = F(2-k-6). 

Having obtained the explicit form of the work distri- 
bution, we turn to the verification of the fluctuation- 
dissipation relations. It will suffice to check the Crooks 
relation which, in the present problem with AF = 0, 
reads P(w) — exp(w)P(— w). The tilde here corresponds 
to velocity inversion. By Fourier transformation, the 
Crooks relation is equivalent with the symmetry con- 
dition G(—q — i) = G(q), which is indeed verified as, 
G(-q -i)- G(q) = -2tv F{9) sin9d9 = 0. The last 
equality follows from the fact that the object is closed. 
The explicit result © allows, by expansion of G(q), to 
evaluate the cumulants k„ of the random variable w: 



K 4 



We next turn to two limits of particular interest. In the 
quasi-static limit v — - > 0, expansion of G(q) in v leads to: 

G(q)^ - 8q ^^ q K 2 r d6F(6) sin 2 9 + 0(v 3 ). (10) 
A Jo 

Hence P(w) converges to S(W) in the strict quasi- 
static limit (G(q) = 0). Keeping the leading term in 
Eq. ijl"T)|) . one concludes that P(w) is Gaussian. This 
level of perturbation corresponds to the linear Gaussian 
regime around equilibrium. The average work reduces 
to the familiar Joule heating, which in original variables, 
reads: (W) ~ ~jV 2 t. Here 7 is the friction coefficient, 
the proportionality factor in friction force versus speed: 
Ffriction = 7V. The expression for the friction coeffi- 
cient 7 agrees with a direct calculation of this quantity 
H, namely 7 = ASp^k B Tm/2Ti F(9) sin 2 6d0. The 
second moment reproduces an equilibrium fluctuation- 
dissipation relation. In original variables: f3(5W 2 ) — 
2(W). The Jarzynski equality implies more generally for 
a Gaussian shape of W that the so-called fluctuation- 
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FIG. 3: Crooks relation J1J for a triangular object with ve- 
locity v = 0.2(r = 50) and v = 2(r = 5). 



dissipation ratio R = f3{5W 2 ) /2{{W) ~ W rev ) be equal 
to one 6J. In the present case, the reversible work, 
W rev = AF, is equal to zero. 

The quasi-static limit has to be compared but also con- 
trasted with the long time limit r — > 00. We first note 
that all the cumulants are proportional to r, a property 
characteristic for processes with independent increments. 
As a result, one finds in the limit t — > 00 that W con- 
verges to (W) (the law of large numbers), and more pre- 
cisely that the random variable (W— (W))/ (5W 2 ) con- 
verges to a normal random variable (central limit theo- 
rem). We stress however that, while in this case the 
dominant part of the probability mass is indeed rendered 
correctly by a Gaussian ansatz centered around (W), the 
validity of the fluctuation theorems rests on the contri- 
bution of the so-called extreme non-Gaussian deviations, 
as all higher order cumulants contribute equally (all pro- 
portional to r) to the Crooks relation. In particular, 
the average work is not related in any obvious way to the 
free energy difference nor does the fluctuation-dissipation 
ratio verify the near equilibrium result R = 1. We fi- 



2t r A„ci„2 fl c -i> 2 sin 2 < 







4?j sin. Op 

(w) = TV I d6F(6){ = + 2 sin 6(1 + 2v 2 sin 2 9) (I + erf[w sin 6]) \, (9a) 



f 2lT ( 2e~ v sin e (l + v 2 sin 2 0) 
(6w 2 ) = 8tv 2 / d9F(9) sin 2 9{ K -= + v sin6»(3 + 2v 2 sin 2 9){\ + erf[vsin6>]) J>, (9b) 







'n 



16tv 3 J * d9F{9) sin 3 9 ^ - - va[li ^> + 2v sin 6 ) + (3 + 12y 2 sin 2 Q + ^ ^ m + erf [w sin 0] ) | ; 

Mtv a / d9F{9) sin 4 
Jo 



(9c) 

27r ( 2e~ y2 si " 2 9 (4 + 9v 2 sin 2 9 + 2w 4 sin 4 9) 



'TV 

+ vsin(9(I5 + 2(V sin 2 9 + 4u 4 sin 4 9){1 + erf [v sin 9] ) } . ( < id ) 

I 



4 



TABLE I: Comparison between molecular dynamics simulation and theory (vt = 10). Cumulants «i, • • • , K4, fluctuation- 
dissipation ratio R, and the Jarzynski average (e~ w ) are shown for the disk (upper part) and triangle (lower part). 
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1.04 1.03 
0.371 0.464 


0.544 0.542 
1.98 2.06 


0.77 
1.01 


1.00 
-1.00 


4.32 4.14 
14.9 15.6 


5.05 4.14 
106. 120. 


0.395 0.189 
0.623 0.679 


0.965 0.737 
0.383 0.511 


0.583 0.500 
3.57 3.85 


0.53 
1.00 


2.00 
-2.00 


6.09 6.08 
48.5 52.0 


10.9 11.0 
855. 1040. 


0.614 0.627 
0.568 0.646 


0.417 0.446 
0.292 0.443 


0.891 0.903 
8.83 10.0 


0.11 
1.10 



nally turn to a comparison of the above analytic results 
with those from hard disk molecular dynamics for a di- 
lute gas with N = 2000 disks of diameter d = 1 and mass 
?7i = 1 (see Refs. 0, @ for the detailed simulation meth- 
ods.) The initial positions and velocities of the disks are 
sampled from a microcanonical ensemble (initial "tem- 
perature" T = 1) in a square box of L=1000 (i.e., initial 
gas density p = 0.002) with periodic boundary condi- 
tions in both x and y directions. Averages were taken 
over 400,000 realizations. Two simple shapes are con- 
sidered for the object: a disk with a diameter A = 10 
(F(8) = l/27r) and an isosceles triangle with a base 
length A = 10 and an apex angle cf> = 20° [F(0) is the 
sum of three delta contributions at the angles 8 = it — <f), 
8 = 37r/2 and 8 — <j)]. For the disk, we have by symme- 
try that P = P. The latter distributions can however be 
very different for the triangle, see below. The triangle is 
placed in such a way that its symmetry axis is parallel to 
the x axis, cf. Fig. [5] An illustrative comparison between 
analytical and simulation results is shown in Figs. lll3l and 
Table |U for a wide range of values of v and r. Overall, 
qualitative agreement is observed. In particular, the pro- 
gressive change in the general shape of the probability 
distribution P(w) from its quasi-static Gaussian shape 
to a very complicated multi-peaked distribution for the 
triangle is well reproduced by the present theory. The 
comparison of moments given in Table [i] confirms this 
agreement. In the linear response regime (R ~ 1), the 
molecular dynamics simulation reproduce quite well the 
Jarzynski equality, meaning that such simulations could 
be used as an accurate estimate of the free energy differ- 
ence (which happens to be zero here). However, as the 
velocity increases, the Jarzynski equality is violated be- 
cause its validity rests on the contribution of extremely 
rare events. Note however the following exception: the 
triangular object moving to the left satisfies the Jarzyn- 
ski equality surprisingly well even when its velocity is 
greater than the mean velocity of the gas particles. The 
intuitive explanation is that negative work, correspond- 



ing to particles hitting the triangle while it moves away 
from them, can be more easily realized by the collision 
on the elongated side of the triangle (see the left panel of 
Fig. EJ) . This observation is also supported at the level of 
the Crooks relation, cf. FigEl an d is in agreement with a 
general argument (C. Jarzynski, private communication) 
that the Jarzynksi equality is verified more easily when 
operating at higher dissipation, cf. Table |U 

We conclude with a few relevant comments. Only in 
the quasi-static limit (including the linear regime around 
equilibrium) is the convergence of P(W) to a delta func- 
tion and to a Gaussian strong enough to be allowed to 
interchange this limit with the Jarzynski average. One 
concludes that (W) converges to AF and the fluctuation- 
dissipation ratio R converges to 1. In the limit r — > 00, 
W , being the sum of independent increments, both law 
of large numbers and central limit theorem apply, but 
the Jarzynski average is dominated by the extreme non- 
Gaussian fluctuations. The present study also illustrates 
that one has to go far out of equilibrium, in case the 
speed of the object comparable to the speed of the par- 
ticles, to see significant deviations from linear response 
theory. Furthermore, one will, in the latter case (R sig- 
nificantly different from 1), typically observe violations 
of the Jarzynski equality because it becomes practically 
impossible to sample extremely rare events. We however 
found an interesting exception to this rule: for the motion 
of a highly asymmetric object, the negative work contri- 
butions of the not-so-rare collisions on its elongated tail 
allow to verify the Jarzynski equality outside the regime 
of linear response. Concomitantly, the Jarzynski equality 
can in such cases be used to estimate free energy differ- 
ences from far from equilibrium measurements. 
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